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3.1 Random Variables 

In a statistical experiment, it is often very important to allocate 
numerical values to the outcomes. 

Example: 

• Experiment: testing two components 

(D=defective, N=non-defective) 

• Sample space: S={DD,DN,ND,NN} 

• Let X = number of defective components. 

• Assigned numerical values to the outcomes are: 



Sample point 
(Outcome) 

Assigned 
Numerical 
Value (x) 

DD 

2 

DN 

1 

ND 

1 

NN 

0 


Notice that, the set of all possible values of the variable X is {0, 1, 2}. 
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Random Variable 


For a given sample space S of some experiment, a random variable is 
any rule (function) that associates a real number with each outcome in S. 

(i.e., X : S — ^ R.) 


Notation: " X " denotes the random variable . 

" x " denotes a particular value of the random variable X. 

Bernoulli Random Variable 


Any random variable whose only possible values are 0 and 1 is called 
a Bernoulli random variable. 
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Types of Random Variables: 


• A random variable X is called a discrete random variable if its set of 
possible values is countable, i.e., x ^ {x p x 2 , . . . } 

A random variable X is called a continuous random variable if it can 
take values on a continuous scale, i.e., x £ {x: a < x < b; a, b^R} 

In most practical problems: 

H) A discrete random variable represents count data, such as the 
number of defectives in a sample of k items. 

O A continuous random variable represents measured data, such as 
height. 
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3.2 Probability Distributions for Discrete Random Variables 


Probability Distribution 

The probability distribution or probability mass function (pmf) of a 
discrete rv X is defined for every number x by 


p(x ) = P(all s e S : X (s) = x) = P(X = x) 

The probability mass function, p(x), of a discrete random variable X 
satisfies the following: 

1 ) p( x ) = P(X =x)>0. 

2 ) J^p(x) = l. 

allx 


Note: 


P(A)= £>(*)= J^P(X=x). 

allxeA allxeA 
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Parameter of a Probability Distribution 


> Suppose that p(x) depends on a quantity that can be assigned any 
one of a number of possible values, each with different value 
determining a different probability distribution. 

>Such a quantity is called a parameter of the distribution. 

>The collection of all distributions for all different parameters is called 
a. family of distributions. 


Example: For 0< a < 1 , 


1 — a 


p(x;a ) 


= <a 


V 


0 


if x = 0 
if x = 1 
otherwise 


Each choice of a yields a different pmf. 
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Cumulative Distribution Function 

The cumulative distribution function (cdf) F(x) of a discrete rv 
variable X with pmfp(x) is defined by 

F{x) = P(X < x) = £>(}>). 

y:y<x 

For any number x, F(x) is the probability that the observed value of X 
will be at most x. 

Proposition 

For any two numbers a and b with a^b 

P(a<X<b) = F(b) - F(a-) 

“a-” represents the largest possible X value that is strictly less than a. 
Note: For integers 

P(a<X<b) = F(b) - F(a-l) 
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Probability Distribution for the Random Variable X 


A probability distribution for a random variable X: 


X 

-3 

-2 

-1 

0 

1 

4 

6 

P(X=x) 

0.13 

0.16 

0.17 

0.20 

0.16 

0.11 

0.07 


Find: 

1) F(x) 

2) P(X > 0) 

3) P(-2 < X < 1) 

4) P(-2 < X < 1) 

5) P(-2 < X < 1) 

6) P(-3 < X < 1) 


= 1- P(X < 0) =1 - F(0) = 1 - 0.66 = 0.34 
= P(-2 < X < 1) = F(l) - F(-2-) = F(l) - F(-3) = 0.69 

= P(-2 < X < 1) = F(l-) - F(-2-) = F(0) - F(-3) = 0.53 

= P(-2 < X < 1) = F(l) - F(-2) = F( 1) - F(-2) = 0.53 

= P(-3 < X < 1) = F(l-) - F(-2) = F(0) - F(-2) = 0. 37 


1) F(x) 


X 

-3 

-2 

-1 

0 

1 

4 

6 

F(x) 

0.13 

0.29 

0.46 

0.66 

0.82 

0.93 

1.00 


Dr. Ammar M. Sarhan 


10 


X 

-3 

-2 

-1 

0 

1 

4 

6 

F(x) 

0.13 

0.29 

0.46 

0.66 

0.82 

0.93 

1.00 



Ph 


1.0 


0.5 


-3 

-2 

-1 0 

i 

2 3 

4 

5 

6 

X 

-3 

-2 

-1 

0 

1 

4 

6 

P(X=x) 

0.13 

0.16 

0.17 

0.20 

0.16 

0.11 

0.07 
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pmf: 


X 

-3 

-2 

-1 

0 

1 

4 

6 

P(X=x) 

0.13 

0.16 

0.17 

0.20 

0.16 

0.11 

0.07 


CDF: 

X 

-3 

-2 

-1 

0 

1 

4 

6 


F(x) 

0.13 

0.29 

0.46 

0.66 

0.82 

0.93 

1.00 


The CDF can be written as 


F(x) = 


< 


0 

0.13 

0.29 

0.46 

0.66 

0.82 

0.93 

1.00 


if x < -3 
if - 3 < x < -2 
if — 2 < x < -1 
if — 1 < x < 0 
if 0 < x < 1 
if 1 < x < 4 
if 4 < x < 6 
if 6<x 


Dr. Ammar M. Sarhan 


12 



Example. 

Tossing a non-balance coin 2 times independently. 
Sample space: S={HH, HT, TH, TT}. 

Suppose P(H) = Vi P(T) ■=> P(H) =1/3 and P(T)=2/3. 
Let X= number of heads 


Sample point 

Value of X (x) 

Probability 

HH 

2 

P(HH) = P(H) P(H) = l/3xl/3=l/9 

HT 

1 

P(HT) =P(H) P(T) = 1/3 x 2/3 = 2/9 

TH 

1 

P(HT) = P(H) P(T) =1/3x213 = 2/9 

TT 

0 

P(TT) = P(T) P(T) = 2/3 x 2/3 = 4/9 


The possible values of X are: 0, 1, and 2. 

X is a discrete random variable. 

Probability distribution of the X 

(X=2)={HH} 1/9 


X 

0 

1 

2 

Total 

P(X=x) 4/9 

4/9 

1/9 

1.0 



(X=1)={HT, TH} 2/9 + 2/9 =4/9 
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P(X<1) = P(X=0)=4/9 

= F(l-) = F(0) =4/9 

P(X<1) = P(X=0) + P(X=1) = 4/9+4/9 = 8/9 
= F(l) = 8/9 

P(X>0.5) = P(X=1) + P(X=2) = 4/9+ 1/9 = 5/9 
= 1-F(0.5-) = l-F(O) = 1-4/9 = 5/9 
P(X>8) = P(cp) = 0 

=1-F(8) = 1-1 =0 

P(X<10) = P(X=0) + P(X=1) + P(X=2) = P (S) = 1 


< ^ 


F(x) 


X 

0 

1 

2 

F(x) 

4/9 

8/9 

9/9 


= F(10) = 1 


0 


if x<0 


F(x) = 


< 


4/9 if 0 < jc < 1 
8/9 if 1 < jc < 2 


1 


if 2 < jc 
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Example : 


A shipment of 8 similar microcomputers to a retail outlet contains 3 
that are defective and 5 are non-defective. If a school makes a 
random purchase of 2 of these computers, find the probability 
distribution of the number of defectives . 


We need to find the probability distribution of the random variable: 
X = the number of defective computers purchased. 


Experiment: selecting 2 computers at random out of 8 


N (S) = 




v2, 


equally likely outcomes 


The possible values of X are: x = 0, 1,2. 



D N 

3 5 


8 computers 
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N(X=0)={0D and 2N} = 


N(X=1)= { ID and IN} = 


N(X=2)={2D and IN} = 


fy 


5 n 


X 




,2y 

f 3 ' 


( 5^ 


X 


A, 


vly 

f 3 ' 


'5) 


X 






15 


P(X=0)= 


vOy 


r*\ 


X 


\-J _ 


^8 ' 


10 

28 




P(X=1)= 


J 

vly 


X 


8 


V 1 / _ 
\ 


15 

28 




U, 


P(X=2)= 


f 3^ 




x 


/ 5' i 


V°/_ - 


^8 n 


v2y 


28 
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The probability distribution of X 


X 

0 

1 

2 

Total 

p(x) = P(X=x) 

10 

28 

15 

28 

A 

28 

1.00 


p(x) = 




f 5 

\ 


X 





<2-. 





\-j 


, x =0,1,2. 


0 , 


otherwise. 


Hypergeometric Distribution 
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3.3 Expected Values of Discrete Random Variables 

The Expected V alue of X 

Let X be a discrete rv with set of possible values D and pmfp(x). The 
expected value or mean value of X, denoted E(X) or p x or p, is 

E(X) = jU x = ^x-p(x). 

x<eD 


Example: Use the data below to find out the expected number of the 
number of credit cards that a student will possess. 


X = # credit cards 



E(X) =XjPj+ x 2 p 2 + ... + x 1 p 1 

=0(0.08) +l(0.28)+2(0.38)+3(0.16)+4(0.06)+5( 0.03) + 6(0.01) 
=1.97~ 2 credit cards 
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The Expected Value of a Function 

If the rv X has the set of possible values D and pmf p(x), then the 
expected value of any function h(x), denoted E[h(X)] or (p hlX| ) is 

E[h(X)] = ju h(x) = Y, h (x) ■ P(x). 

xeD 

Rules of the Expected Value 
E [aX + b] = a ■ E(X) + b 

1) For any constant a, E [aX\ = a ■ E(X) 

2) For any constant b, E[X + b] = E(X) + b 
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The Variance and Standard Deviation 


Let X have pmf p(x), and expected value //. Then the variance of X, 
denoted V(X) (or cr x or O 2 ), is 


V(X) = E[(X-M) 1 }='Z< x -rf-p(x). 

x<eD 


The standard deviation (SD) of X is 



20 
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Example: The quiz scores for a particular student are given below: 

22, 25, 20, 18, 12, 20, 24, 20, 20, 25, 24, 25, 18 
Compute the variance and standard deviation. 

Solution: Let X be the quiz score. 


Value (X) 

12 

18 

20 

22 

24 

25 

Frequency 

1 

2 

4 

1 

2 

3 


p(x ) — > Probability 0.08 0.15 0.31 0.08 0.15 0.23 

/.I = Vr- p(x ) = 21 

x<eD 

V(X) = (Xt-ju) 2 p l +(x l -p) 2 p x +... + (x n -p) 2 p n 

= (12-21) 2 0.08 + (18 - 21) 2 0. 15 + (20 - 21) 2 0.31 + 

(22 - 21) 2 0.08 + (24 - 21) 2 0. 15 + (25 - 21) 2 0.23 = 13.25 

cr = ^V(X) = Vl3.25 * 3.64 

21 
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Shortcut Formula for Variance 


ViX \=v = 


Ys J 

d ' 


-M 




Rules of Variance 


V(aX +b)=o^ +b =a 2 


and a oK t-6 “ 


a 




This Leads to the tbLLou'iris: 

_2 2 2 
F ~ Ll ~ ^X^aX 




X 


22 
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3.4 The Binomial Probability Distribution 

Binomial Experiment 

An experiment for which the following four conditions are satisfied is 
called a binomial experiment. 

1 . The experiment consists of a sequence of n trials, where n is fixed 
in advance of the experiment. 

2. The trials are identical, and each trial can result in one of the same 
two possible outcomes, which are denoted by success (S ) or failure 

(F). 

3. The trials are independent 

4. The probability of success is constant from trial to trial: denoted by p. 


23 


Dr. Ammar M. Sarhan 


23 


Binomial Random Variable 


Given a binomial experiment consisting of n trials, the binomial 
random variable X associated with this experiment is defined as 

X = the number ofS’s among n trials. 


Notation for the pmf of a Binomial rv 

Because the pmf of a binomial rv X depends on the two parameters n 
and p, we denote the pmf by b(x;n,p). 

Computation of a Binomial pmf 


r 


b(x;n,p) = 


< 


f n ^ 


KP) 

0 


p x a-pr x x=ox-,n 


otherwise 


The expected value and Variance of a Binomial distribution 


If X ~ b(x;n,p) 


(1) E(X) = n p (2)V(X) = np(l-p) 




-24- 
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Example: If the probability of a student successfully passing this course 
(C or better) is 0.82, find the probability that given 8 students 

a. all 8 pass. 


P(X =8) = 6(8;8,0.82) = 

b. none pass. 






(0.82) 8 (1-0.82) 0-0 « 0.2044 


8-8 


P(X = 0) = K0;8,0.82) = 


v°y 


(0.82)° (l-0.82)°' u * 0.0000011 


8-0 


c. at least 6 pass. 

P(X > 6) = b{ 6;8,0.82) + Z?(7;8,0.82) + b( 8;8,0.82) 


( 8 °\ ( 8 ^ 

(0.82) 6 (1-0.82) 8 ' 6 + 


v 6 y 

v8y 


v^y 


(0.82) 7 (1-0.82) 


8-7 


(0.82) 8 (1-0.82)°'° « 0.8392 


8-8 
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d. The expected number of students passed the course. 


E(X) = n p = 8 (0.82) = 6.56 ~ 7 students 
e. The variance. 

V(X) = np(l-p) 

= 8 (0.82) (1- 0.82) = 8 (0.82) (0.18) 
= 1.1808 


26 
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3.5 Hypergeometric and Negative Binomial Distributions 

The Hypergeometric Distribution 

The three assumptions that lead to a hypergeometric distribution: 

1 • The population or set to be sampled consists of N individuals, 
objects, or elements (a finite population). 

2. Each individual can be characterized as a success ( S ) or failure (F), 
and there are M successes in the population. 

3. A sample of n individuals is selected without replacement in such a 
way that each subset of size n is equally likely to be chosen. 

If X is the number of S ’s in a completely random sample of size n 
drawn from a population consisting of M S’s and (N-M) F’s, then 
the probability distribution of X will be called the hypergeometric 
distribution. [ h (n,M,N) ] 

27 
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Computation of a Hypergeometric distribution 


P(X =x) = h(x;n,M,N) = 


max(0, n — N + M) < x 



The expected value and Variance of a Hypergeometric distribution 

If X~h(n,M,N) 


(1) E(X) = n 


M 

N 


(2) V(X) = 


f 


\ 


N-n 
N - 1 


\ 


J 


n 


M 

N 


( 


1 - 


V 


M 

N 


\ 


J 
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Example: 

Lots of 40 components each are called acceptable if they contain no 
more than 3 defectives. The procedure for sampling the lot is to select 5 
components at random (without replacement) and to reject the lot if a 
defective is found. What is the probability that exactly one defective is 
found in the sample if there are 3 defectives in the entire lot. 


Solution: 

Let X= number of defectives in the sample. 
X ~ h (n, M,N) = h(5, 3, 40) 


N = 40, M = 3, n = 5. 

M V 37 A 


P(X =x) = 


\ X J 


V 5 -Xj 


" 40 ' 

, 5 , 


, x = 0, 1, 2, 3 


max(0, 5 - 37) = 0 < x < min(5, 3) = 3 
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The probability that exactly one defective is found in the sample is 




P(X= 1) = 


X 


37 


IJ 15 — 1 

r 40 ' 

Is, 


3 \ 


/ 37’l 


x 


w V 4 7 


40 

v.Sy 


= 0.3011 


Example: 

In the previous example, find the expected value and the variance of the 
number of defectives in the sample. 

Solution: 

M 3 3 

(1) E(X) = n — =5— = - = 0.375 

N 40 8 


(2) V(X) = 


f N-n\ 

• n • 

M 

( 

1 - 

M 

U-lJ 

N 

N) 

r 

in 

1 

o 

•5- 

3 

( 

1 - 

V 

3 1 

> 

1 

o 

40 

40 J 


= 0.311298 
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The Negative Binomial Distribution 

The negative binomial rv and distribution are based on an experiment 
satisfying the following four conditions: 

1. The experiment consists of a sequence of independent trials. 

2. Each trial can result in a success (S) or a failure (F). 

3. The probability of success is constant from trial to trial, so 
P(S on trial i) = p for i = 1,2, 3, ... 

4. The experiment continues until a total of r successes have been 
observed, where r is a specified positive integer. 

If X is the number of failures that precede the r-th success, then the 
probability distribution of X will be called the negative binomial 
distribution. [ nb (r, p) ] 


The event (X = x) is equivalent to { r- 1 S’s in the first (x+r- 1 ) trials and 
an S in the (x+r)th}. 

31 
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Computation of a Negative Binomial pmf 


nb(x;r, p ) = 


( x + r — l\ 


v 


r — 1 


p r a-p) x , x = 0,1,2,- •• 


J 


The expected value and Variance of a Negative Binomial 

distribution 

If X ~ ntyr, p. j i > (1) E(X) = r(l-p)/p (2) V(X) = r (1-p )/p 2 


Geometric Distribution: 

When r= 1 in nb(r, p) then the nb distribution reduces to geometric 
distribution. 


32 
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Example: 

Suppose that p=P(male birth ) = 0.5. A parent wishes to have exactly 
two female children in their family. They will have children until this 
condition is fulfilled. 

1 . What is the probability that the family has x male children ? 

Let X be the number of Ms precede the 2nd F . . ; 

The prob. that the family has x male children = P(X=x) 

= nb(x; 2,0.5), x=0,l,2,... 

2. What is the probability that the family has 4 children? 

= P(X = 2) = nb(2; 2, 0.5) = 0.1875 

3. What is the probability that the family has at most 4 children? 

= P(X<2) = P(X=0) + P(X= 1) + P(X = 2) 

= nb( 0; 2,0.5) + nb(l; 2,0.5) + nb(2; 2,0.5) 

= 0.6875 


X ~ nb(2, 0.5) 
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4. How many male children would you expect this family to have? 
How many children would you expect this family to have? 

E(X) = r (1 -p)/p = 2 (1-0.5)/ 0.5 = 2 
2 + E(X) = 2 + 2 = 4 


34 
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3.6 The Poisson Probability Distribution 

A random variable X is said to have a p oisson distribution with 
parameter A (A > 0), if the pmf of X is 

r e~ l 

p(x;A)= — , x = 0,1,2,- •• 

x! 

The Poisson Distribution as a Limit 

Suppose that in the binomial pmf b(x;n, p), we let n — * 00 and p —*■ 0 
in such a way that np approaches a value A (A > 0). Then 

b(x; n,p ) -»• p(x ; A) 

The expected value and Variance of a Poisson distribution 

If X has a Poisson distribution with parameter A , then 

E(X) = V(X) = A 

35 
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Poisson Process 


Assumptions: 

1 . There exists a parameter a > 0 such that for any short time interval of 
length At , the probability that exactly one event is received is 

a At + o(At ) 

2. The probability of more than one event during At is o(At ). 

3. The number of events during the time interval At is independent of 
the number that occurred prior to this time interval. 

Poisson Process 

P k (t) = e~ at (at) k / k! , so that the number of pulses (events) during a 
time interval of length tis a Poisson rv with parameter at. The expected 
number of pulses (events) during any such time interval is at, so the 
expected number during a unit time interval is a. 


36 
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Example: 

Suppose that the number of typing errors per page has a Poisson 
distribution with average 6 typing errors. 

(1) What is the probability that in a given page: 

(i) The number of typing errors will be 7 ? 

(ii) The number of typing errors will be at least 2? 

Let X = number of typing errors per page. z) X ~ Poisson (6) 

P(X = x) = p(x;6) = , x = 0,1,2, •• • 

x\ 

fi 1 p~ 6 

(i) P(X =7) = p(7;6)= = 0.13768. 

7 « 

(ii) P(X >2) = 1-P(X <2) = 1-[P(X =0) + P(X =1)] 

=1 - p( 0; 6) - p(l; 6) = 0.982650 
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(2) What is the probability that in 2 pages there will be 10 typing errors? 


Let X = number of typing errors in 2 pages. 


X ~ Poisson (12) 


10 -12 


P(X = 10 ) = /?( 10 ; 12 ) = 


12 e 


10 ! 


= 0 . 1084 . 


(3) What is the probability that in a half page there will be no typing 
errors? 


Let X = number of typing errors in a half page. 


X ~ Poisson (3) 


3 ° 

P(X = 0 ) = p{ 0 ; 3 ) = = 0 . 049787 1 . 

(3 * 
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